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Abstract 

This paper looks at the theory underlying the science of materials 
from the perspectives of physics, the history of science, and the philos- 
ophy of science. We are particularly concerned with the development 
of understanding of the thermodynamic phases of matter. 

The question is how can matter, ordinary matter, support a di- 
versity of forms. We see this diversity each time we observe ice in 
contact with liquid water or see water vapor (steam) rise from a pot 
of heated water. Different phases can be qualitatively different. For 
example, walking on ice is well within human capacity, but walking 
on liquid water is proverbially forbidden to ordinary humans. These 
differences have been apparent to humankind for millennia, but only 
brought within the domain of scientific understanding since the 1880s. 

The nature of the phases is brought into the sharpest focus in 
phase transitions: abrupt changes from one phase to another and hence 
changes from one behavior to another. A first-order phase transition 
involves a discontinuous jump in some statistical variable. The prop- 
erty with the jump is called the order parameter. Each phase transition 
has its own order parameter. The possible order parameters range over 
a tremendous variety of physical properties. These properties include 
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the density of a liquid-gas transition, the magnetization in a ferromag- 

net, the size of a connected cluster in a percolation transition, and a 
condensate wave function in a superfluid or superconductor. A contin- 
uous transition occurs when the discontinuity in the jump approaches 
zero. This article starts with the development of mean field theory 
as a basis for a partial understanding of phase transition phenomena. 
It then goes on to the limitations of mean field theory and the de- 
velopment of very different supplementary understanding through the 
renormalization group concept. 

Throughout, the behavior at the phase transition is illuminated 
by an "extended singularity theorem", which says that a sharp phase 
transition only occurs in the presence of some sort of infinity in the 
statistical system. The usual infinity is in the system size. Apparently 
this result caused some confusion at a 1937 meeting celebrating van 
der Waals, since mean field theory does not respect this theorem. In 
contrast, renormalization theories can make use of the theorem. This 
possibility, in fact, accounts for some of the strengths of renormal- 
ization methods in dealing with phase transitions. The paper outlines 
the different ways phase transition phenomena reflect the effects of this 
theorem. 
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1 Introduction 



1.1 The discovery and invention of materials 

From the "stone age" through the present day humankind has made use of 
the materials available to us in the earth and equally to materials we could 
manufacture for further use. Jared Diamond[18], for example, in his book 
Guns, Germs and Steel, has pointed out how crucial metalworking was to 
the spread of European power. 

However, it is only in relatively recent times that we were able to bring 
scientific understanding of the inner workings of materials to human bene- 
fit. The latter half of the nineteenth century brought the beginning of two 
major theoretical advances to the science of materials, advances that would 
deepen and grow into the twentieth century so that today we can boast 
of a fundamental understanding of the main properties of many materials. 
These advances are: a theory of statistical physics developed initially by 
Rudolf Clausius[12], J. C. Maxwell [28], and Ludwig Boltzmann[12, 11] and 
an understanding of the different phases of matter based in part upon an 
understanding of the changes from one phase^ to another. These changes 
are called phase transitions and our understanding of them is based upon 
the work of Thomas Andrcws[5], Johannes van dcr Waals[56] and Maxwell. 
It is the purpose of this paper to develop a description of the development of 
these basic ideas from the 1870s to the last quarter of the twentieth century. 

Much of our first principles understanding of materials is based upon the 
fact that they arc composed of many, many atoms, electrons, and molecules. 
This means that we cannot hope or wish to follow any motion of their individ- 
ual constituents, but that instead we must describe their average or typical 
properties through some sort of statistical treatment. Further, though we 
should believe that the properties of these materials is built upon the prop- 
erties of the constituents, we should also recognize that the properties of a 
huge number of constituents, all working together, might be quite different 
from the behaviors we might infer from thinking about only a few of these 
particles at once. P. W. Anderson has emphasized the difference by using 
the phrase "More is Different" [2, 64]. 

There are two surprising differences that have dominated the study of ma- 

^The word "phase" is interesting. According to the Oxford Dictionary of Word His- 
tories (and the Oxford English Dictionary) it entered Enghsh language in the nineteenth 
century to describes the phases of the moon. The Oxford English Dictionary hsts a very 
early use in J. Willard Gibbs' writings about thermodynamics as the "phases of matter". 
Apparently Gibbs then extended the meaning to get "extension in phase" that then got 
further extended into the modern usages "phase transition" and "phase space". 
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terials: irreversibility and the existence of sharply distinct thermodynamic 
phases. First, irreversibility: Even though the basic laws of both classi- 
cal mechanics and quantum mechanics are unchanged under a time reversal 
transformation, any appropriately statistical treatment of systems contain- 
ing many degrees of freedom will not show such an invariance. Instead, such 
systems tend to flow irreversibly toward an apparently unchanging state 
called statistical equilibrium. This flow was recognized by Clausius in his 
definition of entropy, detailed by Boltzmann in his gas dynamic definition of 
the Boltzmann equation, and used by Gibbs[70] in his definitions of thermo- 
dynamics and statistical mechanics. It is a behavior that is best recognized 
as a property of a limiting case, either of having the number of degrees of 
freedom become infinite or having an infinite observation time. Time rever- 
sal asymmetry is not displayed by any finite system described over any finite 
period of time^. 

This paper is concerned with thermodynamic equilibrium resulting from 
this irreversible fiow. It focuses upon another property of matter that, as we 
shall see, only fully emerges when we consider the limiting behavior as an 
equilibrium material becomes infinitely large. This property is the propensity 
of matter to arrange itself into different kinds of structures that are amazingly 
diverse and beautiful. These structures are called thermodynamic phases. 
Figure (1) illustrates three of the many thermodynamic phases formed by 
water. Water has many different solid phases. Other fluids form liquid crys- 
tals, in which we can see macroscopic manifestations of the shapes of the 
molecules forming the crystals. The alignment of atomic spins or electronic 
orbits can produce diverse magnetic materials, including ferromagnets, with 
their substantial magnetic fields, and also many other more subtle forms of 
magnetic ordering. Our economic infrastructure is, in large measure, based 
upon the various phase-dependent capabilities of materials to carry electrical 
currents: from the refusal of insulators, to the flexibility of semiconductors, 
to the substantial carrying capacity of conductors, to the weird resistance- 
free behavior of superconductors. This flow, and other strange properties 
of superconductors, are manifestations of the subtle behavior of quantum 
systems, usually only seen in microscopic properties, but here manifested by 
these materials on the everyday scales of centimeters and inches. I could 
go on and on. The point is that humankind has, in part, understood these 
different manifestations of matter, manifestations that go under the name 

^Particle physics does show a very weak time reversal asymmetry discovered by James 
W. Cronin and Val L. Fitch[24], but this asymmetry is immaterial for all mundane phe- 
nomena. 
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"thermodynamic phases". Scientific work has produced at least a partial un- 
derstanding of how the different phases change into one another. This article 
is a brief description of the ideas contained in the science of such things. 

As is the case with irreversibility, the differences among solid, liquid, 
and gas; the distinctions among magnetic materials and between them and 
non- magnetic materials; and the differences between normal materials and 
superfluids are all best understood as distinctions that apply in the limit 
in which the number of molecules is infinite. For any finite body, these 
distinctions are blurry with the different cases merging into one another. 
Only in the infinite limit can the sharp distinction be maintained. Of course, 
our usual samples of everyday materials contain a huge number of molecules, 
so the blur in the distinction between different phases is most often too fine 
for us to discern. However, if one is to set up a theory of these materials, it 
is helpful to respect the difference between finite and infinite. 

1.2 Different phases; different properties 

Three of the phases of water are illustrated in Figure (1), which depicts a 
snowfiake (a crystal of a solid phase of water) and a splashing of the liquid 
phase. A third phase of water, the low density phase familiar as water vapor 
or steam, exists in the empty-looking region above and around the splashing 
liquid. 

Different phases of matter have qualitatively different properties. As you 
see, ice forms beautiful crj slal structures. So do other soHds, each with its 
own characteristic shape and form. Each crystal picks out particular spa- 
tial directions for its crystal axes. That selection occurs because of forces 
produced by the interactions of the microscopic constituents of the crys- 
tals. CrystalHne materials are formed at relatively low temperatures. At 
such temperatures, microscopic forces tend to line up neighboring molecules 
and thereby produce strong correlations between the orientations of close 
neighbors. Such correlations extend through the entire material, with each 
molecule being lined up by several neighbors surrounding it, thereby produc- 
ing an ordering in the orientation of the molecules that can extend over a 
distance a billion times larger than the distance between neighboring atoms. 
This orientational order thus becomes visible in the macroscopic structure 
of the crystal, as in Figure (1), forming a macroscopic manifestation of the 
effects of microscopic interactions. 

The same materials behave differently at higher temperature. Many melt 
and form a liquid. The long-range orientational order disappears. The ma- 
terial gains the ability to flow. It loses its special directions and gains the 
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Figure 1: Splash and snowflake. This picture is intended to illustrate the 
qualitative differences between the ffuid and solid phases of water. On the left 
is liquid water, splashing up against its vapor phase. Its fluidity is evident. 
On the right is a crystal of ice in the form of a snowflake. Note the delicate 
but rigid structure, with its symmetry under the particular rotations that 
are multiples of sixty degrees. 

full rotational symmetry of ordinary space. 

Many of the macroscopic manifestations of matter can be characterized 
as having broken symmetries. Phases other than simple vapors or liquids 
break one or more of the characteristic symmetry properties obeyed by the 
microscopic interactions of the constituents forming these phases. Thus, a 
snowflake's outline changes as it is rotated despite the fact that the molecules 
forming it can, when isolated, freely rotate. 

The same materials behave differently at higher temperature. Many melt 
and form a liquid. The long-range orientational order disappears. The ma- 
terial gains the ability to flow. It loses its special directions and gains the 
full rotational symmetry of ordinary space. 

Many of the macroscopic manifestations of matter can be characterized 
as having broken symmetries. Phases other than simple vapors or liquids 
break one or more of the characteristic symmetry properties obeyed by the 
microscopic interactions of the constituents forming these phases. Thus, a 
snowflake's outline changes as it is rotated despite the fact that the molecules 
forming it can, when isolated, freely rotate. 

1.2.1 Broken symmetries and order parameters. 

A previous publication [44] describes the development of the theory of phase 
transitions up to and including the year 1937. In that year. Lev Landau[52] 
put together a theoretical framework that generalized previously existing 
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mean field theories of phase transitions. In Landau's approach, a phase 
transition manifests itself in the breaking of a mathematical symmetry. This 
breaking is, in turn, reflected in the behavior of an order parameter describ- 
ing both the magnitude and nature of the broken symmetry. Two different 
phases placed in contact are seen to be distinguished by having different 
values of the order parameter. For example, in a fcrromagnet the order pa- 
rameter is the vector magnetization of the material. Since the spins generate 
magnetic fields, this alignment is seen as a large time-independent magnetic 
field vector, pointing in some particular direction. The order parameter in 
this example is then the vector describing the orientation and size of the 
material's magnetization and its resulting magnetic field. Note that the ori- 
entation of the order parameter describes the way in which the symmetry 
is broken, while the magnitude of this parameter describes how large the 
symmetry breaking might be. 

Other order parameters describe other situations. A familiar order pa- 
rameter characterizes the difference between the liquid and the vapor phases 
of water. This parameter is simply the mass density, the mass per unit vol- 
ume, minus the value of that density at the critical point. This parameter 
takes on positive values in the liquid phase and negative ones in the vapor 
phase. These phases are clearly exhibited in processes of condensation, or 
boiling, or when the two phases are placed in contact with one another. In 
superfluid examples, ones in which there is particle flow without dissipation, 
a finite fraction of the particles are described by a single, complex wave 
function. The order parameter is that wave function. 

The alignment of atomic spins or electronic orbits can produce diverse 
magnetic materials, including ferro magnets, with their substantial magnetic 
fields, and also many subtler forms of magnetic ordering. A crystal in which 
the magnetization can point in any direction in the three-dimensional space 
conventionally labeled by the X, Y, and Z axes is termed an "XYZ" fcrro- 
magnet. Another kind of ferromagnet is called an "XY" system, and is one 
in which internal forces within the fcrromagnet permit the magnetization 
to point in any direction in a plane. The next logical possibility is one in 
which there a few possible axes of magnetization, and the magnetization can 
point either parallel or antiparallel to one of these axes. A simple model 
describing this situation is termed an Ising model, named after the physi- 
cist Ernst Ising[37], who studied it in conjunction with his adviser Wilhelm 
Lenz[10, 63](See Chapter (2)). 
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1.2.2 Dynamics and equilibrium 

We have already mentioned the propensity of condensed matter systems 
to approach an unchanging state called thermodynamic equilibrium. This 

approach can be cither extremely fast or extremely slow, depending upon 
the situation. When an electrical current in a metal is set in motion by an 
applied voltage it can take as little as a millionth of a billionth of a second 
for the current to reach close to its full value. On the other hand, impurities 
may take years to diffuse through the entire volume of a metal. Because 
of this very broad range of time scales, and because of the wide variety of 
mechanisms for time-dependence, dynamics is a very complex subject. 

Equilibrium is much simpler. The equilibrium state of a simple material 
is characterized by a very few environmental parameters. These parameters 
correspond to a knowledge of the amount or availability of the conserved (i.e., 
time-independent) quantities describing the system. To describe a container 
filled with water, one needs to know its temperature, the volume of the 
container, and the applied pressure. One can then directly calculate the 
the mass of the water in the volume using the data from what is called the 
equation of state. 

By the time our story begins, in the early twenthieth century, kinetic 
theory will be well-developed as a description of common gases and liquids. 
That theory includes the statement that molecules in these fluids are in 
rapid motion, with a kinetic energy proportional to the temperature. Ther- 
modynamics provides a more broadly applicable theory, brought close to its 
present state by J. Willard Gibbs in 1878[31, 70, p. 55-371]. That discipline 
provides relations among the properties of many-particle systems based upon 
conservation of energy and the requirement that the system always develops 
in the direction of thermodynamic equilibrium. Thermodynamic calcula- 
tions are based upon thermodynamic functions, for example the Helmholtz 
free energy used in this paper. This function depends upon the material's 
temperature, volume, and the number of particle of various types within it 
One can calculate all kinds of other properties by calculating derivatives of 
the free energy with respect to its variables. The free energy has the further 
important property that the actual equilibrium configuration of the system 
will produce the minimum possible value of the free energy. Any other con- 
figuration at that temperature, in that volume, with those constituents will 
necessarily have a higher free energy. 

To understand phase transitions, one has to go beyond thermodynamics, 
which concerns itself with relations among macroscopic properties of mate- 
rials, to the subject of statistical mechanics that defines the probabilities for 
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observing various phenomena in a material in thermodynamic equihbrium, 
starting from a microscopic description of the behavior of the materials' con- 
stituents. Statistical mechanics further differs from thermodynamics in that 
the latter treats only summed or gross properties of matter, while the former 
looks to the individual constituents and asks about the relative probabilities 
for their different configurations and motions. 

To use statistical mechanics, in principle, all one needs to know is a func- 
tion called the Hamtltoman, which gives the system's energy as a function 
of the coordinates and momenta of the particles.^ In practice, for many- 
particle systems, the actual calculations are sufficiently hard so that in large 
measure they only became possible after World War II. 

Statistical mechanics is classically defined by using a phase space given 
by the momenta and coordinates of the particles in the system. The state of 
a particular classical system is then defined by giving a point in that space. 
The basics of statistical mechanics were put forward by Boltzmann[14, page 
8 and chapter 7], [77], [27] and then clearly stated by Gibbs[30] in essentially 
the same form as it is used today. It describes the probability for finding 
a classical system in a particular configuration, c, in the phase space. The 
probability of finding the system in a small volume of phase space, dfl, 
around configuration c is given by 



Here, H(c) is the energy in this configuration, T is the absolute temperature 
in energy units, and F is a constant, which turns out to be the free energy. 
Since the total probability of all configurations of the system must add up 
to unity, one can determine the free energy by 



where the integral covers all of phase space. 

This probability formulation, the basis of all of statistical mechanics, 
is known as the Maxwell-Boltzmann distribution, to most physicists and 
chemists, or the Gibbs measure, to most mathematical scientists. 

This probability of Eq. (1) describes a collection of identical materials ar- 
rayed in different configurations. Gibbs calls the "ensemble" of configurations 
thus assembled a "canonical ensemble'^." 

^This function is named after William Rowan Hamilton who described how to formulate 
classical mechanics using this Hamiltonian function. 

''The word "canonical" seems to be an somewhat old-fashioned usage for something set 
to a given order or rule. The Oxford English Dictionary traces it back to Chaucer. 



g-(H(c)-F)/T 



(1) 
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Figure 2: Cartoon PVT diagram for 
water. Each curve describes how the 
pressure depends upon volume for a 
fixed temperature. Note the figures 
for critical temperature and pressure 
on this diagram. They apply to wa- 
ter. The corresponding figures of car- 
bon dioxide are 31.1° C and 73 atmo- 
spheres. These values are more eas- 
ily accessible to experiments than the 
ones for water. 
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1.2.3 Phase transitions 

A treatment of phase transitions may properly start with the 1869 experi- 
mental studies of Andrews [5], who investigated the phase diagram of carbon 
dioxide and thereby discovered the qualitative properties of the liquid-gas 
phase transition. His results, as illuminated by the theoretical work of van 
der Waals and Maxwell[56], are shown in Figure (2). This plot gives the 
pressure as it depends upon volume in a container with a fixed number of 
particles. Each curve shows the behavior of the pressure at a given value of 
the temperature. The two curves at the bottom show results quite familiar 
from our experience with water. At high pressures one has a liquid and the 
liquid is squeezed into a relatively small volume. Since the density of the liq- 
uid is the (fixed) number of particles divided by a varying volume, this high 
pressure region is one of high density. The curve moves downward showing 
a reduced pressure as the liquid is allowed to expand. At a sufficiently low 
pressure, the liquid starts to boil, and thereby further reduce its density until 
a sufficiently low volume is reached so that it has attained the density of va- 
por. The boiling is what is called a first-order phase transition. The boiling 
occurs at a constant pressure and has liquid and vapor in contact with one 
another. Then after the vapor density is reached, additional expansion pro- 
duces a further reduced density. At somewhat higher temperatures this same 
scenario is followed, on a higher curve, except that the region of boiling and 
its connected jump in density is smaller. Andrews' big discovery was that 
at a sufficiently high temperature, the jump in density disappears and the 
fluid goes from high pressure to low without a phase transition. This disap- 
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pearance of the first-order phase transition occurs at what is called a critical 
point. The disappearance itself is called a continuous phase transition. 

1.2.4 The first mean field theory 

In his thesis of (1873), Johannes van der Waals[79] put together an approx- 
imate theory of the behavior of liquids using arguments based in ideas of 
the existence of molecules. The very existence of molecules was an idea then 
current, but certainly not proven. Van der Waals started from the known 
relation between the pressure and the volume of a perfect gas, i.e., one that 
has no interactions between the molecules. Expressed in modern form, the 
relation is 

p = T N/V (3) 

Here, p is the pressure, V is the volume of the container, N is the number of 
molecules within it, T is the temperature expressed in energy units^. This 
equation of state relates the pressure, temperature, and density of a gas in 
the dilute-gas region in which we may presume that interactions among the 
atoms are quite unimportant. It says that the pressure is proportional to the 
temperature, T, and to the density of particles, N/V. This result is inferred 
by ascribing an average kinetic energy to each molecule proportional to T 
and then calculating the transfer of momentum per unit area to the walls. 
The pressure is this transfer per unit time. Of course, Eq. (3) does not allow 
for any phase transitions. 

Two corrections to this law were introduced by van der Waals to estimate 
how the interactions among the molecules would affect the properties of the 
fluid. 

First, he argued that the molecules could not approach each other too 
closely because of an inferred short-ranged repulsive interaction among the 
molecules. This effect should reduce the volume available to the molecules 
by an amount proportional to the number of molecules in the system. For 
this reason, he replaced V in Eq. (3) by the available volume, V — Nb, where 
b would be the excluded volume around each molecule of the gas. 

The second effect is more subtle. The pressure, p, is a force per unit 
area produced by the molecules hitting the walls of the container. How- 
ever, van der Waals inferred that there was an attractive interaction pulling 
each molecule towards its neighbors. This attraction is the fundamental rea- 
son why a drop of liquid can hold together and form an almost spherical 

use energy units in order to write fewer symbols. It is more conventional to write, 
instead of T, kT, where k is the Boltzmann constant. 
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Figure 3: PVT curves predicted by 
the theory set up by van der Waals. 
The fluid is mechanically unstable 
whenever the pressure increases as 
the volume increases. 



Reduced volume, VIV, 



shape. As a molecules move toward a wall, it is pulled back and slowed by 
the molecules left behind. Because of this reduced speed, it imparts less mo- 
mentum to the walls than it would otherwise. The equation of state contains 
the pressure as measured at the wall, p. This pressure is the one produced 
inside the liquid, NT/(V — Nb), minus the correction term coming from the 
interaction between the molecules near the walls. That correction term is 
proportional to the density of molecules squared. In symbols Van der Waals' 
corrected expression for the pressure is thus 

p = NkT/{V - Nb) - a{N/V f (4) 

Here, a and b are parameters that are different for different fluids and N/V 
is the density of molecules. 

Eq. (4) is the widely used van der Waals equation of state for a fluid. 
Because it takes into account average forces among particles, we describe it 
and similar equations as the result of a mean field theory. This equation of 
state can be used to calculate the particle density, p = N/V, as a function of 
temperature and pressure. It is a cubic equation for p and thus has at most 
three solutions. 

1.2.5 Maxwell's improvement 

The equation of state proposed by van der Waals is plotted in Figure (3). 
Each curved line shows the dependence of pressure on volume. This equation 
of state has a major defect: it shows no boiling region. Worse yet, it contains 
regions in which, at flxed temperature and numbers of particles, the pressure 
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increases as the volume increases. This situation is unstable. If the fluid finds 
itself in a region with this kind of behavior, the forces within it will cause it 
to separate into two regions, one at a high density the other at a lower one. 
In fact, exactly this kind of separation does happen in the boiling process in 
which a lower density vapor is in contact with a high density liquid. 

The instability just described is termed a mechanical instability. It can 
be triggered by a fluctuation in which two nearby pieces of fluid acquire a 
density slightly different from that of the fluid elements around them. J. 
C. Maxwell[57, 58] in 1874 and 1875 recognized this instabihty and also a 
somewhat larger region of instability triggered by processes in which nearby 
pieces of the acquired got a density appropriate for a thermodynamic equi- 
librium phase of the fluid, one region having a vapor density, the other a 
liquid density. Maxwell identified this larger region of instability with boil- 
ing, and drew a phase diagram like that in Figure (2). Note that this figure 
has a completely flat portion of the constant temperature lines to represent 
the predicted boiling of the Maxwell's theory. We shall hear more of this 
Maxwell construction in Chapter (4). 

Maxwell's result gives a qualitative picture of the jump in density between 
the two phases over a quite wide of temperatures. For the purposes of this 
paper, however, the most important region is the one near the critical point 
in which the jump is small. According to the theory, as the jump in density, 
p = N/V, goes to zero, it shows a behavior 

Piiquid - pgas = Constant x (Tc - (5) 

where Tc is the critical temperature and /3 has the value one half. Andrews' 
data does fit a form like this, however with a value of the exponent, /3, much 
closer to one third than one half. Later on, this discrepancy will become 
quite important. 

Despite the known discrepancy between mean field theory and experi- 
ment in the region of the critical point, few scientists focused upon this issue 
in the years in which mean field theory was first being developed. There was 
no theory or model that yielded Eq. (5) with any power different from one 
half, so there was no focus for anyone's discontent. Thomas Kuhn[51] has 
argued that an old point of view will continues on despite evidence to the 
contrary if there is no replacement theory. 

Following soon after van der Waals, many other scientists developed mean 
field theories, applying them to many different kinds of phase transitions. All 
these theories have an essential similarity. They focus upon some property 
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of the many-particle system that breaks some sort of global symmetry". 
In mean field calculations, the ordering in one part of the system induces 
ordering in neighboring regions until ordering is spread through the entire 
system. Thus mean field theory calculations are always descriptive of symme- 
try breaking and the induced correlations that carry the symmetry breaking 
through the material. These calculations are then most relevant and imme- 
diately useful for the description of the jumps that occur in first-order phase 
transitions. 

1.3 F luct uat ions 

In equiliubrium, the material has a behavior that, in a gross examination, 
looks time-independent. Hence many of the phenomena involved may be 
described by using time-averages of various quantities. This averaging is the 
basis of mean-field-theory techniques. However, a more detailed look shows 
fluctuations, that is time dependence, in everything. These fluctuations will 
call for additional calculational techniques beyond mean field theory, which 
will be realized with the renormalization group methods described in Chapter 
(6). Here, I describe two important examples of fiuctuations that arise near 
phase transitions. 

1.3.1 Fluctuations I: Boiling 

In the process of ordering, typically a material will display large amounts of 
disorder. For example, as the pressure is reduced at the liquid-gas coexistence 
line, a liquid turns into a vapor by an often-violent process of boiling. The 
boiling produces bubbles of low-density vapor in the midst of the higher- 
density liquid. Thus the fluid, which is quite homogeneous away from its 
phase transition, shows a rapidly fluctuating density in its boiling region. 
As every cook knows, one can reduce the violence of the fiuctuations by 
making the boiling less rapid. Nonetheless, it remains true that the fluid 
shows an instability in the direction of fluctuations in its region of boiling in 
the phase diagram. 

®In fact, the liquid-gas case is one of the most subtle of the phase transitions since the 
symmetry between the two phases, gas and liquid, is only an approximate one. In magnets 
and most other cases the symmetry is essentially exact, before is it broken by the phase 
transition. 
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1.3.2 Fluctuations II: Critical opalescence 

A process, not entirely dissimilar to boiling, occurs in the equilibrium fluid 
near its critical point. Observers have long noticed that, as we move close 
to the liquid-gas critical point, the fluid, hitherto clear and transparent, 
turns milky. This phenomenon, called critical opalescence, was studied by 
Marian Smoluchowski (1908) and Albert Einstein (1910) [67, p. 100]. Both 
recognized that critical opalescence was caused by the scattering of light from 
fluctuations in the fluid's density. They pointed out that the total amount 
of light scattering was proportional to the compressibility, the derivative 
of the density with respect to pressure. They also noted that the large 
amount of scattering near the critical point was indicative of anomalously 
large fluctuations in that region of parameters. In this way, they provided a 
substantial explanation of critical opalescence^. 

Figure (5) shows the divergence in the compressibility. 

1.4 Ornstein and Zernicke 

Leonard Ornstein and Prederik Zernike[66]subsequently derived a more de- 
tailed theory of critical opalescence. In modern terms, one would say that 
the scattering is produced by small regions, droplets, of materials of the two 
different phases in the near-critical fluid. The regions would become bigger 
as the critical point was approached, with the correlations extending over a 
spatial distance called the correlation or coherence length, ^. Ornstein and 
Zernike saw this length diverge on the line of coexistence between the two 
phases of liquid-gas phase transition as the critical point was approached in 
the form 

^ = constant x 1/|T - Td" with u = 1/2 (6) 

with T — Tc being, once again, the temperature deviation from criticality. 
Thus the correlation length does go to infinity as the critical point is ap- 
proached. This result is crucially important to the overall understanding of 
the critical point. It is a realization of the extended-singularity-theorem idea 
that the phase transition, or more specifically criticality, reflects correlations 
over an infinite region of the system. 

'^Einstein then used the explanation of this physical effect to provide one of his several 
suggested ways of measuring Avogadro's number, the number of molecules in a mole of 
material. 
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1.5 Outline of paper 

The next chapter defines the Ising model, a simple and basic model for phase 
transitions. It then uses that model to describe the extended singularity theo- 
rem, which describes the relationship between phase transitions, mathemat- 
ical singularities in thermodynamic functions, and correlated fluctuations. 
Chapter (3) then defines mean field theories as one way of approaching the 
theory of phase transitions. The next chapter. Chapter (4), describes the 
1937 Landau theory as the pinnacle of mean field theory descriptions, but it 
is also the start of the replacement of that theory by fluctuation-dominated 
approaches. In that same year, a conference in Amsterdam exhibited the con- 
fusion caused by the conflict between mean field theory and the extended 
singularity theorem. The long series of studies that indicated a need for 
supplementing mean field theory is described in Chapter (5). Finally Chap- 
ter (6) describes the development of a new phenomenology and theory to 
understand fluctuations in phase transitions. 

2 The Ising model 

2.1 Definition 

The Ising model is a conceptually simple representation of a system that can 
potentially show ferromagnetic behavior. Its name comes from the physicist 
Ernst Ising[37], who studied it^ in conjunction with his adviser Wilhelm 
Lenz[10]. Real ferromagnets involve atomic spins placed upon a lattice. The 
elucidation of their properties requires a difficult study via the band theory 
of solids. The Ising model is a shortcut that catches the main qualitative 
features of the ferromagnet. It puts a spin variable upon each site, labeled 
by r, of a simple lattice. (See Figure (4).) Each spin variable, a^, takes on 
values plus or minus one to represent the possible directions that might be 
taken by a particular component of a real spin upon a real atom. 

The sum over configurations is a sum over all these possible values. The 
Hamiltonian for the system is the simplest representation of the fact that 
neighboring spins interact with a dimensionless coupling strength, K, and a 
dimensionless couphng to an external magnetic field, h. The Hamiltonian is 
given by 

-H/T = Kj2(^r(^s + hJ2(^r (7) 

nn r 

®Much of the historical material in this work is taken from the excellent book on critical 
phenomena by Cyril Domb[20]. 
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Figure 4: Lattice for two-dimensional 
Ising model. The spins are in the cir- 
cles. The couplings, K, are the lines. 
A particular site is labeled with an 
"r". Its nearest neighbors are shown 



where the first sum is over all pairs of nearest neighboring sites, and the 
second is over all sites. The actual couphng between neighboring spins, with 
dimensions of an energy, is often called J. Then K = —J/T. In turn, h is 
proportional to the magnetic moment of the given spin times the applied 
magnetic field, all divided by the temperature. Since lower values of the 
energy have a larger statistical likelyhood, the two term in Eq. (7) reflect 
respectively a tendency of spins to line up with each other and also a tendency 
for them to line up with an external magnetic field. 



2.2 The extended singularity theorem 

Particle spin is certainly a quantum mechanical concept. There is no simple 
correspondence between this concept and anything in classical mechanics. 
Nonetheless, the concept of spin fits smoothly and easily into the Boltzmann- 
Gibbs formulation of statistical mechanics. When spins are present, the 
statistical sum in Eq. (2) includes a quantum summation over each spin- 
direction. In the Ising case, when the only variable is a, standing for the 
z-component of the spin, that summation operation is simply a sum over the 
two possible values plus one and minus one of each spin at each lattice site. 

For the Ising model, the integral over configurations in Eq. (2) is replaced 
by a sum over the possible spin values, thus making the result have partic- 
ularly simple mathematical properties. Take the logarithm of that equation 
and find: 

-F/r = ln[^e-«('=)/^] (8) 

c 
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On the right hand side of this equation one finds a simple sum of exponen- 
tials. This is a sum of positive terms and it gives a result that is a smooth 
function of the parameters in each exponential, specifically the dimensionless 
spin-coupling, K, and the dimensionless magnetic field h. A logarithm of 
a smooth function is itself a smooth function. Therefore it follows directly 
that the free energy, is a smooth function of h and K. 

The reader will notice that this smoothness seems to contradict our def- 
inition of a phase transition, the statement that a phase transition is a sin- 
gularity, i.e., failure of smoothness, in some thermodynamic quantity. 

This seeming contradiction is the key to understanding phase transitions. 
No sum of a finite number of smooth terms can be singular. However, for 
large systems, the number of terms in the sum grows quite rapidly with the 
size of the system. When the system is infinite, the number of terms in infi- 
nite. Then singularities can arise. Thus all singularities, and hence all phase 
transitions, are consequences of the influence of some kind of inflnity. Among 
the likely possibilities are infinite numbers of particles, infinite volumes, or 
-more rarely- infinitely strong interactions. Real condensed matter systems 
often have large numbers of particles. A cubic centimeter of air contains 
perhaps 10^" particles. When the numbers are this large, the systems most 
often behave almost as if they had an infinity of particles. 

I am going to give a name to the idea that phase transitions only occur 
when the condensed matter system exhibits the effect of some singularity 
extended over the entire spatial extent of the system. Usually the infinity 
arises because some effect is propagated over the entire condensed system, 
that is, over a potentially unbounded distance. I am going to call this result 
the "extended singularity theorem," despite the fact that the argument is 
rather too vague to be a real theorem. It is instead a slightly imprecise 
mathematical property of real phase transitions.^ 

This theorem is only partially informative. It tells us to look for a source 
of the singularity, but not exactly what we should seek. In the important and 
usual case in which the phase transition is produced by the infinite size of the 
system, the theorem tells us that any theory of the phase transition should 
look to things that happen in the far reaches of the system. What things? 
How big are they? How should one look for them? Will they dominate the 
behavior near the phase transition or be tiny? The theorem is uninformative 

^Imprecision can often be used to distinguish between the mathematician and the 
physicist. The former tries to be precise, the latter sometimes uses vague statements that 
can then be extended to cover more cases. However, in precisely defined situations, for 
example the situation defined by the Ising model, the extended similarity "theorem" is 
actually a theorem [36]. 
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Figure 5: Cartoon view of a singu- 
larity in a phase transition. The 
magnetic susceptibility, the derivative 
of the magnetization with respect 
to magnetic field, is plotted against 
temperature for different values of A^. 
The thick solid curve is shows the sus- 
ceptibility in an infinite system. The 
dashed curves apply to systems with 
finite numbers of particles, with the 
V higher line being the larger number of 
■p^ -|- particles. The compressibility of the 

liquid-gas phase transition also shows 
this behavior. 



on all these points. 

Sometimes it is very hard to see the result of the theorem. In an Ising or 
liquid-gas phase transition there is a singularity in the regions just touching 
the coexisting phases[23, 4]. This singularity is very weak. One must use 
indirect methods to observe or analyze it. Conversely, near critical points, 
singularities are very easy to observe and measure. For example, in a ferro- 
magnet, the derivative of the magnetization with respect to applied magnetic 
field, is infinite at the critical point. (See Figure (5).) 

By looking at simulations of finite-sized Ising systems one can see how the 
infinite size of the system enters the susceptibility. Figure (5) is a set of plots 
of susceptibility versus temperature in an Ising system with a vanishingly 
small positive magnetic field. The different plots show what happens as the 
number of particles increases toward infinity. As you can see, the finite N 
curves are smooth, but the infinite-A^ curve goes to infinity. This infinity 
is the singularity. It does not exist for any finite value of A'^. However, as 
A^ gets larger, the finite-A^ result approaches the infinite-A^ curve. When 
we look at a natural system, we tend to see phase transitions that look 
very sharp indeed, but are actually slightly rounded. However, a conceptual 
understanding of phase transitions requires that we consider the limiting, 
infinite- A^, case. 

Figure (6) is the phase diagram of the Ising model. The x axis is the 
magnetic field; the y axis is the temperature. This phase diagram applies 
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Figure 6: Phase diagram for ferro- 
magnet and Ising model. The jump 
in magnetization occurs at zero mag- 
netic field. In this representation, the 
jump region has been reduced to a 
line running from zero temperature 
up to the critical point. 



when the lattice is infinite in two or more dimensions. There is no phase 
transition for lower dimensionality. 

3 More is the same 

This chapter describes mean field theory, which forms the basis of much of 
modern many-particle physics and field theory. So far, we said that an infi- 
nite statistical system sometimes has a phase transition, and that transition 
involves a discontinuous jump in a quantity called the order parameter. But 
we have given no indication of how big the jump might be, nor of how the sys- 
tem might produce it. Mean field theory provides a partial and approximate 
answer to that question. 

We begin with the statistical mechanics of one spin in a magnetic field. 
Then, we extend this one-spin discussion to describe how many spins work 
together to produce ferromagnetism. 

3.1 One spin 

A single spin in a magnetic field can be described by a simplification of the 
Ising Hamiltonian of Eq. (7), —H/T = ha. As before, a is a component 
of the spin in the direction of the magnetic field. This quantum variable 
takes on two values ±1, so that probability distribution of Eq. (1) gives the 
average value of the spin as 

<(T>= ^ (7 e^"-^ = ia.ukh (9) 

(T=±l 
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(In general, we write the statistical average of any quantity, q, as < q >. ) 

3.2 Many spins; mean fields 

The very simple result, Eq. (9), appears again when one follows Pierre 
Curie[16] and Pierre Weiss[83] in their development of a mean field theory 
of ferromagnetism. Translated to the Ising case, their theory would ask us 
to concentrate our attention upon one Ising variable, say the one at r. We 
would then notice that this one spin would see a field with the value 

h{r)+K Yl ^« (10) 
s nn to T 

where h{r) is the dimensionless magnetic field at r and the sum covers all 
the spins with positions, s, sitting at nearest neighbor sites to r. To get the 
mean field result, replace the actual values of all the other spins, but not the 
one at r, by their average values and find, by the same calculation that gave 
Eq. (9) a result in which the average is once more 

< CTr >=tanh/i*'^(r) (11a) 

but now the actual field is replaced by an effective field 

h''^{r) = h{r) + K Yl <^s> (lib) 

s nn to r 

3.3 Mean field results 

Given this calculation of basic equations for the local magnetization, < cJr >, 
we can go on to find many different aspects of the behavior of this mean field 
magnet. We notice that when h is independent of position, the equation for 
< a > has a critical point, i.e., an ambiguity in its solution, at zero magnetic 
field and Kz = 1. When we expand the equations around that critical point, 
we can find that the magnetization obeys a cubic equation like that of the 
van der Waals theory (or equally the Landau theory as described below in 
Sec. (4.1)). Thus, there is a full and complete correspondence between the 
van der Waals theory of the liquid-gas transition and the ferromagnetic mean 
field theory near its critical point, as one can see by comparing Figure (2) 
with Figure (6). 

A brief calculation using the mean field theory gives the magnetic suscep- 
tibility, the derivative of the magnetization with respect to magnetic field, 
to diverges as 1/\T — Td near the critical point. The analogy just mentioned 
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between the liquid-gas system and the magnetic phase transition makes this 
magnetic susceptibiHty the direct analog of the compressibility, that had an 
infinity which was used by Einstein to explain critical opalescence. (See Sec. 
(1.3.2)) 

On the other hand, Ornstein and Zernike calculated the fluid analog of 
the more disaggregated quantity 

called the spin correlation function. A sum over all lattice sites, s, of this 
correlation function will give the susceptibility. Then g can be evaluated 
from the equations of mean field theory[42, page 232] as 

e-|r-s|/? 

in the simplest case: three dimensions, h = 0, t small but greater than 
zero, and separation distance large compared to the lattice spacing, a. In 
Eq. (13), ^ is the correlation length that describes the range of influence 
of a change in magnetic field. Its value, given by Eq. (6), shows that the 
correlation length diverges as critical is approached. This behavior is an 
expected consequence of the extended singularity theorem, which asks for 
infinite ranges of influence at phase transitions. 

We previously argued that the extended singularity theorem called for 
fluctuations extending over large distances. Indeed that call is precisely 
answered by Eq. (13) and Eq. (6). A theorem of statistical mechanics 
relates the correlation function to spin fluctuations via 

g{r, S) =< CTrds > - < CTr >< O-g > = < (o-r- < f^r >){(^s- < >) > (14) 

Note the scaling of the spin correlation function. For relatively small 
values of the distance, the correlation function in Eq. (13) has a form in 
which g varies as one divided by the distance. It is conventional to describe 
this correlation function, varying as |r — s|~^^, by saying that there are two 
local quantities contributing to the correlation and then saying that each 
scales as distance to the power x. Therefore in this case, the index going 
with the order parameter is x = 1/2. 

3.4 Representing critical behavior by power laws 

The reader will, no doubt, have noticed the appearance of "power laws" in 
the description of behavior near critical points. In these laws, some critical 
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property is written as a power of a quantity that might become very large 
or very small, as for example, magnetization — constant X . So far, we 
have seen laws like this in the behavior of the order parameter (Eq. (5)), the 
correlation length(Eq. (6)), the magnetic susceptibility(Figure (2.2)), and 
the correlation function(Eq. (13)). Why does this power function appear 
repeatedly? 

All of this singular behavior is rooted in the fact that phase transitions 
produce a variation over a tremendous range of length scales. For example, 
the basic interactions driving most phase transitions occur on a length scale 
described by the distance between atoms or molecules, that is some fraction 
of a nanometer (lO^'^ meters). On the other hand, we observe and work with 
materials on a characteristic length scale of centimeters (10~^ meters). The 
crucial issue in phase transitions is how does the material interpolate phe- 
nomena over this tremendous length scale. The answer is roughly speaking 
that all the physical quantities mentioned follow the changes in the length 
scale. 

As we shall see in Sec. (6.6), in renormalization calculations, the changes 
of the length scale in turn follows from multiplicative laws. To get to a 
tremendous change in length scale, ^, one puts many small steps ^i, ^3) ■ " " 
into the renormalization calculation and the big change is produced by the 
multiplication of these factors, 

^ = ^1 X £2 X £3 X • • • . 

This kind of behavior is explicitly built into renormalization calculations^*^. 

Scale transformation is a symmetry operation. It describes an underlying 
symmetry of nature in which every scale- kilometer, centimeter, nanometer- 
is equally good for describing nature's basic laws. Whenever a physical phe- 
nomenon reflects a symmetry operation, observed physical quantities must 
be mathematical representations of that symmetry operation. That is why 
we use scalars, vectors and tensors to describe quantities that obey, say, the 
usual rotational symmetry. The same thing works for scale transformations. 
Here, power laws reflect the symmetries built into multiplication operations. 
The physical quantities behave as powers, P ^ where x can be rational or 
irrational, positive or negative, or indeed zero. In the last case, the limiting 

^° Calculations of the effects of scale changes are much more implicit in mean field theo- 
ries than in renormalization theories. In both cases we are treating variation over a huge 
range of scales, and power laws are a likely way of describing this huge range of variation. 
However, because the mean field theories deal less directly with scale transformations they 
do not get the relation between the renormalization scalings of fluctuations and free energy 
quite right. 
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behavior is that of a logarithm instead of a power, as is actually obtained in 
the heat capacity of the Onsager solution[65] of the two-dimensional Ising 
model. 

The wide range of length scales also applies in particle physics where the 
basic scales for interactions may be vastly different from the scale at which 
observations are performed. Thus, in particle physics it is also true that 
renormalization and scaling have to interpolate behaviors over very large 
length scales. 

Whenever one has a power law, say < a >= {—t)^, one has an power, 
here /3. This power is called a "critical exponent" or a "critical index". During 
the many years in which critical behavior has been a subject of scientific 
study, many human-years of scientific effort has been devoted to the accurate 
determination of these indices. Sometimes scientists complained that this 
effort was misplaced. After all, there is little insight to be obtained from 
the statement that /3 (the index that describes the jump in the liquid-gas 
phase transition) has the value 0.31 versus 0.35 or 0.125 or 0.5. But these 
various values can be obtained from theories that give a direct calculation 
of critical quantities or related them one to another. The calculations or 
relations come from ideas with considerable intellectual content. Finding the 
index-values then gave an opportunity to check the theory and see whether 
the underlying ideas were sound. Thus the small industry of evaluating 
critical indices supports the basic effort devoted to understanding critical 
phenomena. 

4 The Year 1937: A Revolution Begins 
4.1 Landau's generalization 

Lev Landau followed van der Waals, Pierre Curie, and Ehrenfest in noticing 
a deep connection among different phase transition problems[17]. Landau 
translated this observation into a mathematical theory in a novel and in- 
teresting way. Starting from the recognition that, in the neighborhood of a 
critical point, each phase transition was a manifestation of a broken symme- 
try, he used the order parameter to describe the nature and the extent of 
symmetry breaking[52]. 

Landau generalized the work of others by writing the free energy as an 
integral over all space of an appropriate function of the order parameter. 
The dependence upon r indicates that the order parameter is considered to 
be a function of position within the system. In the simplest case, described 
above, the phase transition is one in which the order parameter, say the 
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magnetization, changes sign. In that case, the appropriate free energy 
takes the form 

-F/T = J dr[A/i(r)^(r) + B *(r)2 + C ^'(r)^ + L> [V*(r)]2 + ---] (15) 

where A, B,C, . . . are parameters that describe the particular material and 
^'(r) is the order parameter at spatial position r. In recognition of the 
delicacy of the critical point, each term goes to zero more rapidly than ^'(r)^ 
as criticality is approached. 

The next step is to use the well-known rule of thermodynamics that the 
free energy is minimized by the achieved value of every possible macroscopic 
thermodynamic variable within the system. Landau took the magnetization 
density at each point to be a thermodynamic variable that could be used to 
minimize the free energy. Using the calculus of variations one then gets an 
equation for the order parameter: 

= ^(r) + 2{B/A) ^{r) + 4{C/A) ^{rf - 2{D/A) V'^^{r) (16) 

One would get a result of precisely this form by applying the mean field the- 
ory magnetization equation near the critical point. The B-teim is identified 
by this comparison as being proportional to the temperature deviation from 
criticahty, B = - At/2. 

In some sense, of course. Landau's critical point theory is nothing new. 
All his results are contained within the earlier theories of the individual phase 
transitions. However, in another sense his work was a very big step forward. 
By using a single formulation that could encompass all critical phenomena 
with a given symmetry type, he pointed out the close similarity among dif- 
ferent phase transition problems. And indeed in the modern classification 
of phase transition problems[46] the two main elements of the classification 
scheme are the symmetry of the order parameter and the dimension of the 
space. Landau got the first one right but not, at least in this variational 
formulation, the second classifying feature. On the other hand. Landau's in- 
clusion of the space gradients that then brought together the theory's space 
dependence and its thermodynamic behavior also seems, from a present-day 
perspective, to be right on. 

^^The symmetry of the phase transition is reflected in the nature of the order parameter, 
whether it be a simple number (the case discussed here), a complex number (supercon- 
ductivity and superfluidity), a vector (magnetism), or something else. 
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4.2 Summciry of mean field theories 

As already mentioned, Landau's 1937 result provides a kind of mean field 
theory that agrees in all essential ways with the results of the main previous 
workers. The only difference is that Landau produced a specialized theory 
intended to apply mostly to the region near the critical point. From the 
point of view of the discussion that will follow the main points of his theory 
and the earlier ones are: 

• Universality. The Landau theory gives an equation for the order pa- 
rameter as a function of the environmental parameters that is universal: 
It only depends upon the kind of symmetry reflected in the ordering. 

• Symmetry. A first-order phase transition is often, but not always, a 
reflection of a change in the basic symmetry of the condensed system. 

• Interactions. This symmetry change is usually caused by local interac- 
tions among the basic constituents of the system. 

• Scaling. The results depend upon simple ratios of the environmental 

parameters raised to powers. For example in the ferromagnetic transi- 
tion all physical quantities depend upon the ratio /h?'. In subsequent 
theories, the restriction to simple powers will disappear. 

• Order parameter jump. There is a discontinuous jump in the order 
parameter at the first-order phase transition as in Eq. (5). The jump 
goes to zero as the critical point is approached, with critical index 
/3 = 1/2. 

• Correlation length. The correlation length goes to infinity at criticality 
as in Eq. (6) with an index u = 1/2. 

As we shall see, for many purposes, the mean field theories have been re- 
placed by a renormalization group theory of phase transitions. The qualita- 
tive properties of mean field theory, like universality and scaling, have been 
retained. On the other hand, all the quantitative properties of the theory, 
for example, the values of the critical indices, have been replaced. 

4.3 Away from corresponding states — toward universality 

Landau's calculation represented the high-water mark of the class of theo- 
ries described as "mean field theories". He showed that all of them could be 
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covered by the same basic calculational method. They differed in the sym- 
metries of the order parameter, and different symmetries could give different 
outcomes. However, within one kind of symmetry the result was always the 
same. This uniform outcome was very pleasing for many students of the sub- 
ject, particularly so for the physicists involved. We physicists especially like 
mathematically based generalizations and Landau had developed an elegant 
generalization, which simplified a complex subject. 

However, Landau's uniformity was different from the theoretical idea of 
uniformity that had come before him. Earlier work had been based upon 
the idea that different fluids have almost identical relations between their 
pressure temperature and density. This idea is called the "principle of corre- 
sponding states." 

This principle of corresponding states had broad support among the sci- 
entists working on phase transitions. Starting with van der Waals, contin- 
uing with the work of Einstein[67, p. 57], George Uhlenbeck, and E. A. 
Guggenheim [34], work on phase transitions was inspired by the aim and 
hope that the phase diagrams of all fluids would be essentially ahke. How- 
ever, Landau's work marked a new beginning. His method would apply only 
near a critical point and his version of corresponding states could be expected 
to apply only in this region. So Landau deepened the theory but implicitly 
also narrowed its domain of application to a relatively small region of the 
phase diagram. This was the start of a new point of view, which we shall see 
develop in the rest of this paper. The new point of view would come with a 
new vocabulary so that instead of corresponding states people would begin 
to use the word "universality [41]." 

4.4 Statistical confusion: A meeting in the Netherlands 

The extended singularity theorem (Sec Chapter (2).) presents both an op- 
portunity and a challenge for understanding phase transitions. The theorem 
is self-evident in the case of the Ising model with its simple sums and expo- 
nentials. It is less obviously true for the statistical mechanics of the liquid-gas 
phase transition since, in this case, the calculation of the free energy includes 
integrals and also unbounded potentials. However, the theorem remains true 
for that transition. Thus the theorem would then demand an infinite sys- 
tem for a sharp liquid-gas phase transition. On the other hand, the van der 
Waals mean field argument would, for example, give a sharp phase transition 
in small systems. This contradiction might serve as a confusing element in 
the development of a theory of phase transitions. 

The contradiction was as old as the first definitions of statistical mechan- 



28 



ics and phase transitions, but was apparently not discussed for many years. 
It might well, however, have come up at a 1937 meeting held in Amsterdam 
to celebrate the centenary of van der Waals' birth. Hendrik Kramers, George 
Uhlenbeck, and Peter Debye were all present at that occasion. According to 
Uhlenbeck[78], at that meeting Kramers pointed out that the sharp singu- 
larity of a phase transition could only occur in a system with some infinity 
built in and, for that, that an infinite system is required. Then the van der 
Waals theory's prediction of a phase transition in a finite system could be 
viewed as a grave failure of mean field theory and maybe even of statistical 
mechanics. E. G. D. Cohen's described material by Uhlenbeck[15]: "Appar- 
ently the audience at this van der Waals memorial meeting in 1937, could 
not agree on the above question, whether the partition function could or 
could not explain a sharp phase transition. So the chairman of the session, 
Kramers, put it to a vote." According to the story I heard, again based upon 
the recollection of Uhlenbeck, after some discussion the meeting voted on 
the proposition "Can statistical mechanics describe the liquid state." The 
meeting is said to have split 50-50, with Debye (!) voting no! 

Clearly half the people at that meeting were wrong. Seventy plus years 
later one can see the right answer, in close analogy to our understanding of 
irreversibility. Infinite size is required for a sharp phase transition, but a 
large system can very well approximate the behavior of the infinite system. 
Finite size slightly rounds off and modifies the sharp corners shown in the 
plot of Figure (2). Conventional statistical mechanics, following the path 
begun by Andrews, van der Waals, and Maxwell, can describe quite well 
what happens in the liquid region, especially if one stays away from the 
critical region and from boiling. In fact, there are theories, including one by 
John Weeks, David Chandler, and Hans Anderson[l], that do a good job of 
describing the liquid region of the fiuid. 

However, the extended singularity theorem does have its effects. There 
are indeed singularities near the first-order transition[23, 4]. These singular- 
ities are very weak in the Ising and liquid-gas transition, but will be stronger 
when an unbroken symmetry remains after the symmetry breaking of the 
first-order transition. (We see such a residual symmetry in the Heisenberg 
model of ferromagnctism. ) Also, there are quite strong singularities in 
the neighborhood of the critical point, not correctly described by mean field 
theory.All these singularities are consequences of fiuctuations, which are not 
included in the mean field approach. 

However, the Amsterdam meeting was quite right, in my view, to be 
disquieted by the applicability of statistical mechanics. But they focused 
upon the wrong part of the phase diagram. The liquid region is described 
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correctly by statistical mechanics. But this theory does not work well in 
the two-phase, "boiling", region of Figure (2). Here the fluctuations entirely 
dominate and the system sloshes between the two phases. The behavior 
of the interface that separates the phases is determined by delicate effects 
of dynamics and previous history, and by hydrodynamic effects including 
gravity, surface tension, and the behavior of droplets. Hence the direct ap- 
plication of statistical mechanics is fraught with difficulty precisely in the 
midst of the phase transition. Thus, the extended singularity theorem sug- 
gests that a new theory is required to treat all the fluctuations appearing 
near singularities. 

5 Beyond (or Beside) Mean Field Theory 

Weaknesses of mean field theory began to become apparent to the scien- 
tific community immediately after Landau's statement of the theory in its 
generalized form. This chapter will describe the process of displacement of 
mean field theory, at least for behavior near the critical point, which we 
might say began in 1937 and culminated in Kenneth Wilson's enunciation of 
a replacement theory in 1971 [88]. 

Landau's theory provided a standard and a model for theories of general 
phenomena in condensed matter physics. Looking at Landau's result one 
might conclude that a theory should be as general and elegant as the phe- 
nomena it explained. The mean field theories that arose before (and after) 
Landau's work were partial and incomplete, in that each referred to a partic- 
ular type of system. That was certainly necessary in that the details of the 
phase diagrams were different for different kinds of systems, but somewhat 
similar for different materials of the same general kind. Landau's magisterial 
work swept all these difficulties under the rug and for that reason could not 
apply to the whole phase diagram of any given substance. Thus, if Landau 
were to be correct he would most likely be so in the region near criticality. 
Certainly his theory is based upon an order parameter expansion that only 
is plausible in the critical region. However, precisely in this region, as we 
shall outline below, both theoretical and experimental facts contradicted his 
theory. 

5.1 Experimental facts 

The ghosts of Andrews and van der Waals might have whispered to Lan- 
dau that a theory that predicts P = 1/2 near criticality cannot be correct. 
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However a much larger body of early work on fluids had pointed to this con- 
clusion. These early data, developed and published by J.E. Verschaffelt [80] 
and summarized by Levelt Sengers[56], touched almost every aspect of the 
critical behavior of fluids. Verschaffelt particularly stresses the incompati- 
bility of the data with mean fleld theory. 

These same experimental facts appear once more in the 1945 work of 

E. A. Guggenheim [34], who compared data for a wide variety of fluids. He 
says "The principle of corresponding states may safely be regarded as the 
most useful by-product of van der Waals' equation of state. While this [van 
der Waals] equation of state is recognized to be of little or no value, the 
principle of corresponding states as correctly applied is extremely useful and 
remarkably accurate." He examined data for seven fluids on the line of the 
liquid-gas phase transition, and fit the data to a power law with (3 = 1/3, 
rather than the mean field value j3 = 1/2. The latter value clearly does not 
work; the former fits reasonably well. Thus "corresponding states" receives 
support in this region, but not mean field theory per se. 

But neither Guggenheim nor Heike Kamerlingh Onnes[56] before him was 
ready to receive information suggesting that behavior in the critical region 
was special, so that the former rejected mean field theory while the latter 
accepted it with reservations as to its quantitative accuracy. 

Later, near-critical data on heat capacity, the derivative of average energy 
with respect to temperature, became available. Mean field theory predicts 
a discontinuity in the constant volume heat capacity as in Figure (7). L. 

F. Kellers[47] looked at the normal fiuid to superfiuid transition in helium- 
4. (See Figure (8).) The data on this phase transition seemed to support 
the view that the heat capacity diverges weakly, perhaps as a logarithm 
of \T — Tc\, as criticality is approached. Similar heat capacity curves were 
observed by Alexander Voronel'[6, 82] in the liquid-gas transition of classical 
gases, and in further work in helium[60]. 

5.2 Theoretical facts 

As we have seen, experimental evidence suggested that mean field theory 
was incorrect in the critical region. A further strong argument in this di- 
rection came from Lars Onsager's exact solution [65] of the two-dimensional 
Ising model, followed by G.N. Yang's calculation [90] of the zero-field magne- 
tization for that model. Onsager's result for the heat capacity diverged as 
the logarithm oi T — Tc as did the experimental observations, as shown for 
example in Figure (8), but did not resemble the discontinuity of mean field 
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Figure 7: Cartoon sketch of heat 
capacity in neighborhood of critical 
temperature as predicted by mean 
field theory. The heat capacity is 
higher below Tc because there is an 
additional temperature dependence 
in the free energy in this region pro- 
duced by a term proportional to the 
square of the order parameter. 
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Figure 8: Heat capacity as measured. This picture, the work of Moldover 
and Little[60], shows measured heat capacities for the normal-superfuid tran- 
sition of helium-4, labeled as Tx, and the liquid- vapor transition of helium-3 
and helium-4. Note that all three heat capacities seem to go to infinity, in 
contrast to the prediction of mean field theory. These data certainly draw 
one's attention to the critical region. 





































1 










Tc 




— 

T 



32 



theory. 

Yang's results, for which /? = 1/8, also disagreed with mean field theory, 
which has /3 = 1/2. The Onsager solution implies a correlation length with 
ly = 1, which is not the mean field value v = 1/2; see Eq. (6). 

The most systematic theoretical discrediting of mean field theory came 
from the series expansion work of the King's College (London) school, un- 
der the leadership of Cyril Domb, Martin Sykes, and -after a time- Michael 
Fisher[20, 63]. Recall that the Ising model is a simplified model that can be 
used to describe magnetic transitions. It is described by a strength of the 
coupling between neighboring spins proportional to a coupling constant J. 
The statistical mechanics of the model is defined by the ratio of coupling 
to temperature, specifically K = —J/T. One can get considerable informa- 
tion about the behavior of these models by doing expansions of quantities 
like the magnetization and the heat capacity in power series in for high 
temperatures, and for low temperatures. The group at King's devel- 
oped and used methods for doing such expansions and then analyzing them 
to obtain approximate values of critical indices like (3 and u. The resulting 
index-values in two dimensions agreed very well with values derived from 
the Onsager solution. In three dimensions, models on different lattices gave 
index values roughly agreeing with experiment on liquids and magnetic ma- 
terials, but differing substantially from predictions of mean field theory. This 
work provided a powerful argument indicating that mean field theory was 
wrong, at least near the critical point. It also played a very important role 
in focusing attention upon that region. 

Another reason for doubting mean field theory, ironically enough, came 
from Landau himself. In 1941, Andrei Kolmogorov[48] developed a theory of 
turbulence based upon concepts similar to the ones used in mean field the- 
ory, in particular the idea of a typical velocity scale for velocity differences 
over a distance r. These differences would, in his theory, have a characteris- 
tic size that would be a power of r. Landau criticized Kolmogorov's theory 
saying that it did not take into account fluctuations [26], whereupon Kol- 
mogorov modified the theory to make it substantially less similar to mean 
field theory[49]. 

^^Onsager's results looked different from those depicted in Figure (8) in that they 
showed much more symmetry between the high temperature region and the low tem- 
perature region. This difference reflects the fact that two-dimensional critical phenomena 
are markedly different in detail from three-dimensional critical phenomena. Further, sub- 
sequent work has indicated that none of the heat capacity singularities shown in Figure 
(8) are actually logarithmic in character. They are all power law singularities. 
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5.3 Spatial structures 

The spatial structure of mean field theory does not agree with the theorem 
that phase transitions can only occur in infinite systems. Mean field theory 
is based on the alignment of order parameter values at neighboring sites, 
so that particles will order if neighboring particles are ordered also. Any 
collection of coupled spins can have a mean field theory phase transition. 
Thus, two spins and a bond are quite sufficient to produce a phase transition 
in a mean field argument like that in Sec. (3.2). On the other hand, the 
extended singularity theorem insists that the occurance of a phase transition 
requires some sort of infinity, most often the existence of an infinite number 
of interacting parts within the system. 

As we shall see, what is wrong with mean field theory is that in the 
critical region the effect of the average behavior of the order parameter can 
be completely swamped by fluctuations in this quantity. In 1959 and 1960, A. 
P. Levanyuk[55] and Vitaly Ginzburg[32] described a criterion that one could 
use to determine whether the behavior near a phase transition was dominated 
by average values or by fluctuations. For example, when applied to critical 
behavior of the type seen in the simplest version of the Ising model, this 
criterion indicates that fluctuations dominate in the critical region whenever 
the dimension is less than or equal to four. Hence mean field theory is 
wrong[46] for all the usual critical phenomena in systems with dimension 
smaller than or equal to four^'^. Conversely, this criterion suggests that 
mean fleld theory gives the leading behavior above four dimensions. 

6 New Foci; New Ideas 

6.1 Bureau of Standards conference 

So far, the field of phase transitions had lived up perfectly to Thomas 
Kuhn's[51] view of the conservatism of science. Before World War II, the 
only theory of phase transitions was mean fleld theory. No theory or model 
yeilded Eq. (5) with any value of /3 different from one half. There was no 
focus for anyone's discontent. For this reason, the mean-fleld-theory point 
of view continued on, despite evidence to the contrary, until a set of events 

There are exceptions. Mean field theory works quite well whenever the forces are suf- 
ficiently long-ranged so that many different particles will interact directly with any given 
particle. By this criterion mean field theory works well for the usual superconducting 
materials studied up through the 1980s[7, 8], except extremely close to the critical point. 
However, mean field theory does not work for the newer "high-temperature superconduc- 
tors", a class discovered in 1986 by Georg Bednorz and Alexander Miiller[9]. 
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occurred that would move the field in a new direction. One crucial event was 
the conference on critical phenomena held at the U.S. National Bureau of 
Standards in 1965 [61]. The late Melville Green was the moving spirit behind 
this meeting. The point of this conference was that behavior near the critical 
point formed a separate body of science that might be studied on its own 
merits, independent of the rest of the phase diagram. In the years just before 
the conference, enough work[19, 22, 35] had been done so that the conference 
could serve as an inauguration of a new field. We have mentioned the exper- 
imental studies of Kellers and of Voronel's group. At roughly the same time 
important theoretical work was done by Alexander Patashinskii and Valery 
Pokrovsky[68], Benjamin Widom[84, 85] and myself [38], which would form 
a basis for a new synthesis. The experimental and theoretical situation just 
after the meeting was summarized in reviews[46, 35, 22]. This section begins 
by reporting on those new ideas and then describes their culmination in the 
work of Kenneth G. Wilson[88]. 

6.2 Correlation function calculations 

For many years the Landau group had been using field theory to describe the 
critical point. Two young theoreticians, Patashinskii and Pokrovsky, focused 
their attention upon the correlated fluctuations of order parameters at many 
different points in space. Their result was simple but powerful. Consider the 
result of calculating the average of the product of m local order parameter 
operators at m different positions, r^, in a system at the critical point. (All 
differences between positions of the operators should be large in comparison 
to the distance between neighboring sites or the range of forces.) Compare 
this average with the same correlation function calculated at the positions 
£ X Tjn- All that has been done is to change the length-scale on which the 
correlations have been defined. Patashinskii and Pokrovsky then argued 
that this change in scale was an invariancc of the system so that the two 
correlation functions will have precisely the same structure[68], and differ by 
a factor £~"^^. A similar rule, with a different index holds, for other kinds 
of fluctuating quantities near the critical point [69]. These authors succeeded 
in getting the right general structure of the correlations, but in their initial 
work[68] they did not succeed in predicting values of critical indices. This 
work pointed the way toward future fleld theoretic calculations of correlation 
behavior. 

In parallel, I calculated[39] the long-distance form of the spin correlation 
function for the two-dimensional Ising model by making use of the Onsager 
solution. This was the part of a long series of calculations that would give 
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insight into the structure of that model[59]. Those insights would be quite 
crucial in establishing the fundamental theory of behavior at the critical 
point. 

6.3 Widom scaling 

Benjamin Widom[84, 85] (see Figure (9)) reported at the National Bureau of 
Standards meeting upon a phenomenological theory of the thermodynamics 
near critical points. (He studied the liquid-gas transition, but here his re- 
sults will be stated in the language of the magnetic transition, in which the 
temperature deviation from criticality is t and the symmetry of the ordering 
is broken by a magnetic field, h.) If t is zero, the average order parame- 
ter, < a >, was experimentally seen to be proportional to h^^^ where 5 is 
a critical index known to be close to 4.4 in three dimensions [86] and 15 in 
two dimensions [46]. As discussed above, if /i = and t < 0, then < a > 
is proportional to ib(— i)^. He then said that, near the critical point, no 
one of these three quantities has a natural size, but instead each one should 
be measured against the size of the others. This led him to suggest [84] a 
general formula for the magnetization near the critical point, that could fit 
both limiting forms, specifically 

<a>= h^/^g{h^/^/fP) (17) 

where g \s s, function that would have to be determined experimentally. 

In this way Widom got very concrete and precise results from his initial 
requirement that each small quantity, < u >,h,t, etc. be measured against 
another small quantity. He was able to predict the index-value to describe 
how every thermodynamic quantity would go to zero or infinity at criticality. 
All these critical indices would then be determined from just the two indices, 
/3 and S. 

These results were published in a paper[84] in the Journal of Chemical 
Physics. In an adjacent paper, Widom also got a scaling relation[85] for the 
surface tension, the free energy of the boundary between liquid and vapor, 
by relating it to the coherence length. To get this, think of an interface 
covered by many structures produced by the critical behavior. One might 
expect these structures to have a characteristic size of a correlation length, 
and that each such structure would bring in an extra free energy of order T. 
Therefore one expects that the entire interface would produce an extra free 
energy per unit area of order of T times the number of structures that could 
be placed to fill a unit area. 

In view of Eq. (6), which ascribes a critical 
index v to ^, we would have a surface tension that varies as t^'^. This result 
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Figure 9: Benjamin 
Widom, left, and 
Michael Fisher, right. 
Widom is a Chemistry 
Professor at Cornell. 
Fisher has been at 
King's College (Lon- 
don), Cornell, and the 
University of Maryland. 



derived by Widom must have pleased him very much since it shed light on 
a difficulty that went back to van der Waals. The theory of the latter gave 
a critical index for the surface tension of 1.5, while van der Waals' and later 
experiments gave results in the range 1.22-1.27. Widom's new theory offered 
a hope that this old discrepancy between theory and experiment could soon 
be resolved. 

An estimation essentially similar to the one Widom used for the sur- 
face tension indicates that the singular term in the bulk free energy has an 
expected behavior like t^^ . This result follows from the idea that the free en- 
ergy in a three-dimensional system would have its singular part determined 
by excitations with an energy of order T. These excitations would have a 
size equal to the correlation length and a density equal to the inverse cube of 
the correlation length. Thus, the surface tension and the free energy density 
provide a bridge between an understanding of the correlation length and an 
understanding of thermodynamic properties. This bridge is not like anything 
contained in the mean field theories. In fact these relations, termed hyper- 
scaling relations, are the most characteristic feature of the renormalization 
theory that will soon arrive on the scene. 

6.4 Less is the same: Block transforms and scaling 

Widom supplied much of the answer to questions about the thermodynamics 
of the critical point. I then supplied a part of the strategy for deriving 
the answer [38]. I will now describe the method in a bit of detail since the 
calculation provides some insight into the structure of the solution. 

Imagine calculating the free energy of an Ising model near its critical 
temperature based upon the interactions incorporated in Ising's Hamilto- 
nian function for the problem. The result will depend upon the number of 
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lattice sites, the temperature deviation from criticality and the dimension- 
less magnetic field. Next imagine redoing the calculation using a new set 
of variables constructed by splitting the system into cells containing several 
spins and then using new spin variables, each intended to summarize the 
situation in a block containing several old spin variables. (See Figure (10).) 
To make that happen one can, for example, pick the new variables to have 
the same direction as the sum of the old spin variables in the block and 
the same magnitude as each of the old variables. The change could then be 
represented by saying that the distance between nearest neighboring lattice 
sites would change from its old value, a, to a new and larger value, a' . (See 
Figure (10), in which the lattice constant has grown by a factor I = 3.) In 
symbols, the change is given by 

a! = ia (18a) 

One can then do an approximate calculation and set up a new "effective" 
free energy calculation that will give the same answer as the old calculation 
based upon an approximate "effective" Hamiltonian making use of the new 
variables. Near the critical point, one could argue on the basis of universal- 
ity^^ that the new Hamiltonian could be written to have the same structure 
as the old one. However, near criticality, the new parameters in the effective 
Hamiltonian, the number of lattice sites, the temperature deviation from 
criticality, and the dimensionless magnetic field all are proportional to the 
corresponding old parameters. This change can be represented by writing 

N' = {ey^N (18b) 
h' = {£)yhh (18c) 
t' = {i)yH (18d) 

In the first of these statements, Eq. (18b), is the number of lattice sites 
in the d is the dimension of the lattice. The equation simply describes how 
the number of sites depends upon the spacing between lattice sites. 

The other two equations are far, far less simple. Eq. (18c) says that the 
new situation has a symmetry breaking field of the same sign as the previous 
one. That would be a reflection of the fact that both situations would have 
the same kind of ordering. The coefficient, (£)^'', might be derived after some 
sort of statistical mechanical analysis of the situation. It is, as it stands, just 

used Eqs. (18), but I did NOT make an explicit argument based upon universality 
in my paper in which I first applied this block transformation. My discussion would have 
been much stronger had I the wisdom to do so. But wisdom often comes after the fact. 
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a number defined by the result of that calculation and one that might depend 
upon the exact way in which we chose to define the new spin variable. 

The equation for the new value of the new deviation from criticality, 
t = Kc — K, could be described in similar terms. It is reasonable to assume 
that if the original system is at its critical point, so is the new description 
obtained after the block transformation. Further it is reasonable to argue 
that the transformation should engender no singularities, thus requiring that 
a new temperature-deviation from criticality would have a linear dependence 
upon the old deviation. So the remaining point is to calculate the coefficient 
in the linear relation, and express it in the special manner given in Eq. (18d). 

The proportionality in Eq. (18d) and Eq. (18c) are representations of 
scaling, and the coefficients in the linear relations define the scaling relations 
among the variables. Note that here scaling is viewed as a change in the 
effective values of the thermodynamic parameter produced by a change in 
the length scale at which the system is analyzed. The length scale must be 
irrelevant to the determination of the eventual answer and must drop out 
of the final result for the free energy. It is this dropping out that gives the 
empirical relations proposed by Widom. These scaling relations then give a 
theory with all the empirical content of Widom's work[84], but backed by 
the outlines of a conceptual and calculational scheme. 

This theoretical work of references [68, 84, 38] was well-received. The 
review paper of [46] was particularly aimed at seeing whether the new phe- 
nomenology agreed with the experimental data. It reviewed most of the 
recent experiments but missed large numbers of the older ones that are in- 
cluded in references [5 6, 20]. All of this activity validated the consideration 
of the critical region as an appropriate subject of study and led to a spate 
of experimental and numerical work, but hardly any further theoretical ac- 
complishments until the work of Wilson[88]. 

6.5 Physical space; Fourier space 

Before entering into Wilson's construction of the renormalization group the- 
ory, I should touch upon a point of technique. 

There are two traditional ways of setting up a Hamiltonian or free energy 
that will then provide a microscopic description of the system. One way is 
in coordinate space, the real XYZ space in which you and I live. This 
setup is the one we used for the Ising model, the Landau theory, and for the 
description of the previous subsection. It is relatively easy to visualize and 
the most effective method for problems in low dimensions, specifically for 
phase transitions in two dimensions. 
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Figure 10: Making blocks. In this 
illustration a two-dimensional Ising 
model containing 81 spins is broken 
into blocks, each containing 9 spins. 
Each one of those blocks is assigned 
a new spin with a direction set by the 
average of the old ones. We imagine 
the model is reanalyzed in terms of 
the new spin variables. 



The other method employs Fourier transforms. It represents every vari- 
able in terms of its Fourier transform. For example the order parameter field 
of the Landau theory has a transform 



V'(k) = / dr *(r)e-*"". (19) 



The integral covers a space of dimensionality d. Using ipCk) as our basic 
statistical variable the Landau free energy may be written as 



-F/T =J j0y! [Ah{-k)^{k) + B |V'(k)p - D A;2|^(k)|2 

+C! J^.! jtv^J V'(-k-m-n)^(m)^(n)V;(k)] (20) 

This form in Eq. (20) is used to reach beyond mean field theory and take 
into account possible fluctuations in the local variables that describe the 
system. To do this, one uses F/T as a kind of a kind of Hamiltonian for 
phase transition problems. In this use, the k— space is divided into small 
pieces and V'(k) is taken to be an integration variable in each piece. In this 
context the expression in Eq. (20) is called the Landau-Ginzburg- Wilson 
free energy. 

The /c-shell integration just described is easily performed if the free en- 
ergy includes only linear and quadratic terms in the variable, V'(k)- The 
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fourth-order term provides a problem, one that can be attacked by using the 
renormahzation method. The term involving k'^ ensures that the contribu- 
tion to the integral for the highest values of k will be small and relatively 
easily controlled. So, one successively integrates over shells in k— space, 
starting from the highest values of |k|, and working downward. As each in- 
tegral is done, one stops and regroups terms to bring everything back close 
to the form of the original Landau-Ginzburg- Wilson free energy. As one does 
this, the coefficients multiplying the various terms change. 

The k— space method is particularly appropriate for higher dimensions, 
going down to roughly three dimensions. It is the usual method of choice 
in particle physics. In statistical physics, Wilson and Fisher[89] have done 
a very convincing calculation in which they analyze the behavior near four 
dimensions by assuming that the fourth-order term is quite small. (See the 
discussion of e-expansion in Sec. (6.9.1) below.) 

Both real-space and k— space methods have added considerably to our 
understanding of phase transitions. I use the former to describe the concept 
of renormahzation since I find it more natural to think about phenomena in 
real space rather than Fourier space. In particle physics, however, our basic 
conceptualization is based upon, naturally enough, particles. These are best 
followed in k— space, since the k labels the momentum of particles. So the 
two different formulations are complementary, with the best applications to 
problems in different dimensionalities and indeed to different fields of science. 

The extended singularity theorem, of course, applies equally in both the 
real-space and the Fourier-space formulations. In real-space, in order to have 
the potential for generating singularities, and thereby phase transitions, the 
system must be infinite in two or more dimensions. In Fourier-space, the 
corresponding statement is that two or more components of the k-vector 
must extend to infinity. The remaining requirement in either formulation 
is that the renormahzation must lead to a non-trivial fixed point, one with 
infinitely large values of some of the couplings. 

6.6 The Wilson revolution 

Around 1970, these concepts were extended and combined with previous 
ideas from particle physics[71, 29] to produce a complete and beautiful theory 
of critical point behavior, the renormahzation group theory of Kenneth G. 
Wilson[88]. (See Figure (6.6).) The basic idea of reducing the number of 
degrees of freedom, described in reference [38], was extended and completed. 

Wilson, in essence, converted a phenomenology into a calculational method 
by introducing ideas not present in the earlier phenomenological treatment [38]: 
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Figure 11: Kenneth G. Wilson. His 

graduate studies were carried out at 
the Cahfornia Institute of Technol- 
ogy where he did a thesis under Mur- 
ray Gell-Mann, a major contributor 
to early work on renormalization in 
particle physics. This was followed 
by a Junior Fellowship at Harvard, 
a year's stay at CERN, and then 
an academic appointment at Cornell. 
The renormalization group work was 
done while Wilson was at Cornell. 



Instead of using a few numbers, e.g. t, h, to define the parameters mul- 
tiplying a few coupling terms, he extended the list of possible couplings 
to include all the kinds of terms that might be found in the Hamilto- 
nian of the system. Thereby it became automatically true that the 
renormalization would maintain the different coupling terms, but only 
change the size of the parameters which multiplied them. 

Wilson considers indefinitely repeated transformations, as in the ear- 
lier particle physics work. Each transformation increases the size of 
the length scale. In concept, then, the transformation would eventu- 
ally reach out for information about the parts of the system that are 
infinitely far away. In this way, the infinite spatial extent of the sys- 
tem became part of the calculation. The idea that behaviors at the far 
reaches of the system would determine the thermodynamic singularities 
were thence included in the calculation. 

Furthermore, Wilson added the new idea that a phase transition would 
occur when the transformations brought the coupling to a fixed point. 
That is, after repeated transformations, the couplings all would settle 
down to a behavior in which further renormalization transformation 
would leave them unchanged. 

Finally, at the fixed point, the correlation length would be required to 
be unchanged by renormalization transformations. The transformation 
multiplies the length scale by a factor that depends upon the details 
of the transformation. Wilson noted that there are two ways that the 
correlation length might be unchanged. For transformations related 
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to a continuous transition, the correlation length is infinite, thence 
reflecting the infinite-range correlation. For transformations related to 
first-order transitions, the correlation length is zero, reflecting the local 
interactions driving the transition. 

A very important corollary to the use of repeated transforms is the idea 
of running coupling constants. As the length scale changes, so do the values 
of the different parameters describing the system. In the earlier field theo- 
retical work[71, 29], the important parameters were the charge, masses, and 
couplings of the "elementary" particles described by the theory. These pa- 
rameters were specified at the beginning and were, in no sense, the outcome 
of the renormalization calculation. The change in length scale then changed 
these prespecified parameters from the "bare" values appearing in the basic 
Hamiltonian to renormalized values that might be observed by experiments 
examining a larger scale. In the new theory, the number and type of rel- 
evant parameters were determined by the outcome of the renormalization 
calculation. 

The use of renormalized or "effective" couplings was current not only 
in particle theory, but also in quasiparticle theories that are pervasive in 
condensed matter physics [3]. In these theories one deals with particles that 
interact strongly with one another. Nonetheless, one treats them using the 
same Hamiltonian formalism that one would use for non-interacting parti- 
cles. The only difference from free particles is that the Hamiltonian is allowed 
to have a position and momentum dependence that reflects the changes pro- 
duced by the interactions. Here too, as in the early particle physics work, the 
quantities to be renormalized are prespecified. In contrast, see Sec. (6.6.2), 
Wilson's renormalization calculation determines what is to be renormalized. 

6.6.1 Different kinds of fixed points 

Wilson's theory gives three different kinds of fixed point corresponding to 
three qualitatively different points in phase diagrams. For the weak cou- 
pling fixed point, couplings can go to zero and the correlation length goes to 
zero. The symmetry represented by the order parameter will remain unbro- 
ken. This kind of fixed point describes all areas of the phase diagram that 
do not touch a phase transition. For the strong coupling fixed point, some 
couplings will go to infinity and the correlation length goes to zero. Here 
the basic symmetry represented by the order parameter gets broken by at 
least one non-zero couphng that violates that symmetry. This kind of fixed 
point describes all areas of the phase diagram that touch a first-order phase 
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transition. For the critical fixed point couplings remain finite, the symmetry 
remains unbroken, and a correlation length goes to infinity. 

6.6.2 Different scalings: relevant, irrelevant, marginal 

Since the Wilsonian point of view generated the renormalization of many 
different couplings, it became important to keep track of the different ways 
in which the couplings in the free energy would change as the length scale 
changes. This work starts with an eigenvalue analysis. One takes linear 
combinations of couplings arranging the combinations so that, after a renor- 
malization, every combination reproduces itself except for a multiplicative 
factor. In other words, these linear combination make every linear combina- 
tion of couplings obey an equation like the ones in Eqs. (18), so that every 
combination, s, obeys 

s' = iy^s (21) 

The different combinations are then classified according to the values of the 
index, yg. Many of the combinations of couplings have an index that is 
complex, but I shall focus upon the cases in which the index is real. That is 
the most significant situation, anyhow. There are then three possibilities 

• Relevant, yg greater than zero. These are the couplings like t and h 

that grow larger as the length scale is increased. Each of these will, 
as they grow, push one away from the critical point. In order to reach 
the critical point, one must adjust the initial Hamiltonian so that these 
quantities are zero. 

• Irrelevant, yg less than zero. These coupling will get smaller and 
smaller as the length scale is increased so that, as one reaches the 
largest length scales, they will have effectively disappeared 

• Marginal, yg equal to zero. 

The last case is rare. Let us put it aside for a moment and argue as if only 
the first two existed. 

6.6.3 Universality classes 

To study critical phenomena based upon renormalization transformations, 
one sets all the relevant combinations of couplings to zero and then does 
a sufficient number of successive renormalizations so that all the irrelevant 
combinations have also disappeared. We thus end up with a unique fixed 
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point independent of the value of all of the irrelevant couplings. The act 
of renormalization is a sort of focusing in which many different irrelevant 
couplings fade away and we end up at a a single fixed point represent- 
ing a whole multi-dimensional continuum of different possible Hamiltonians. 
These Hamiltonians form what is called a universality class. Each Hamilto- 
nian in its class has exactly the same critical point behavior, with not only 
the same critical indices, but also the same long-ranged correlation functions, 
and the same singular part of the free energy function. 

The identity among different problems is not just a theoretical artifact. 
As first pointed out by Lee and Yang[53, 54], the Ising model, single axis 
ferromagnets, and the liquid-gas phase transition all show identical critical 
properties. The theory makes these critical properties vary with dimension, 
and experiments bear out the predicted universality in the two observable 
cases: d = 2 and d = 3. As another example, XY ferromagnets have a two 
component order parameter, with the same symmetry properties as super- 
fluids, with their complex order parameter. In three dimensions, the critical 
behavior of XY ferromagnets and superfluids fall into the same universality 
class, but, of course, one that is quite different from the universality class 
that applies equally to the critical behavior of the liquid-gas phase transition 
and the Ising model. 

This universality-class idea has been applied to many different problems 
beyond critical plicnomcna-'^'''. Whenever two systems show an unexpected or 
deeply rooted identity of behavior they are said to be in the same universality 
class. 

There are, of course, many different universality classes corresponding to 
different dimensionalities, different symmetries of the order parameter, and 
to different stability properties of the fixed points. 

Before leaving this subject, focus once more on the possibility of a marginal 
behavior. In the marginal case, we have a coupling that does not vary under 
renormalization. That kind of coupling can produce critical properties that 
vary continuously as some parameter is varied. For example a pair of cou- 
pled Ising models living in the same space show a marginal behavior of this 
kind [45]. A slightly different marginal behavior is shown by the XY model 

^^I must admit to a certain pride connected with universality. The 1967 review paper[46j 
in which I participated was organized about universality classes. One might also notice 
that word "universality" was translated from the Russian and was borrowed by me from 
the conversation of Sasha Polyakov and Sasha Migdal and thus imported into the English 
language, with this specific meaning[41]. Alternatively, one might argue that universality 
was a product of many different authors, including Robert Griffiths[33] as well as the 
entire King's college school[20]. 
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in two dimensions [50, 21]. 
6.7 New concepts 

The renormalization revolution and the phenomenological work that pre- 
ceded it included several very important new ideas that were applied not 
only to critical phenomena but also to many other situations. These new 
concepts include, in addition to the analysis of couplings described above, 

• Fluctuations. The behavior at the critical point is determined by fluc- 
tuations in all kinds of physical quantities, with the order parameter 
being the most important. 

• Scaling. Near criticality, fluctuations occur over a very wide range of 
length scales. The near-critical couplings like t and h can each be 
measured against powers of the relevant length scale. The renormal- 
ization group calculation gives the values of critical indices to describe 
the scaling behavior of the physical quantities that deflne the critical 
point. 

• UniversaHty classes. The universahty idea was used to classify all the 
different possible behaviors at critical points. There are only a limited 
number of different universality classes. When different phase transi- 
tion fall into the same class, all aspects of their critical behavior then 
turn out to be identical. For example, the liquid-gas phase transition 
and the Ising model are in the same universality class. 

• Symmetry. Different symmetries and different numbers of dimensions 
imply different universality classes. Thus a superfluid transition on a 
surface is quite different from one in bulk. 

In one sense the renormalization group is rather different from anything 
that had come before in statistical physics, and by extension in other parts 
of physics as well. Previous work in statistical physics had emphasized find- 
ing the properties of problems defined by statistical sums, each sum being 
based upon a probability distribution defined by particular values of cou- 
pling constants like K and h. Such sums would be called solutions to the 
problems in question. In the renormalization group work the emphasis is 
on connecting problems by saying that different problems could have iden- 
tical solutions. The method involved finding different values of couplings 
that would then give identical free energies and other properties. These set 
of couplings would then form a representation of a universality class. All 
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the interactions that flow into a given fixed point in the course of an infi- 
nite number of renormahzations belong to the universality class of that fixed 
point 

A universality class would give a solution, in the old sense, if one finds 
within the class a set of couplings so simple that the solution is obvious. 
This is what happens when the running couplings produce infinitely weak 
interactions, thereby producing a weak coupling fixed point. A strong cou- 
pling fixed point might also be trivial if no important symmetry remains 
after the order parameter takes on a non-zero value. However, a first-order 
phase transition might produce a nontrivial situation with quite a bit of re- 
maining symmetry. In that case, further analysis is necessary before one can 
get anything like a solution in the old sense of the word. 

Finally, a critical fixed point is not really a "solution" in the old sense. It 
gives us values of critical indices and describes scaling behavior, which can 
then be used to infer many of the qualitative properties of a solution. But 
many of the details of the old-sense solution may not be available from a 
knowledge of the fixed point alone. 

6.7.1 Extended singularities revisited 

The rcnormalization group has an entirely different spatial structure from 
that of mean field theory. The difference can best be seen by comparing the 
Ising model mean field theory of Sec. (3) with the block spin formulation of 
Sec. (6.4). 

In the mean field formulation, the value of an average magnetization 
at point r is determined, first of all, by the values of the magnetization at 
points connected by bonds to the initial point. These are then determined, 
in turn, by magnetizations at points connected these new points by bonds. 
This bonding process might continue indefinitely or terminate after a finite 
number of steps. Mean field theory does not have the right spatial structure 
for the correct prediction of phase transitions. 

In contrast, the blocking procedure of the rcnormalization group deter- 
mines the couplings in a given region, in the first analysis, by the effects 
of couplings in a region of size I larger. The blocking then reaches out in 
geometric progression to regions each expanded by a factor of i. 

Of course, the block transformation reach out more quickly and effec- 
tively than do the steps of the mean field calculation. But that is not the 
main difference. The mean field theory can have a pseudo-phase transi- 
tion determined by just a few couplings. On the other hand, if the block 
transformation ever reaches out and sees no more couplings in the usual ap- 
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proximation schemes ([62]) that will signal the system that a weak coupling 
situation has been encountered and will cascade back to produce a weak 
coupling phase. Hence the blocking approach has the potential of using the 
right fact about the spatial topology to determine the possibility of a phase 
transition. 

By this argument the extended singularity theorem suggests that phase 
transitions are triggered by a very elegant mathematical juxtaposition put 
before us by mother nature. On one hand, the phase transition is connected 
with a symmetry operation built into the microscopic couplings of the sys- 
tem. For example, the ferromagnetic based upon the breaking of a symmetry 
in the possible direction of spins. One the other hand the phase transitions 
also make use of the extended topology of an system that extends over an 
effectively infinite region of space. This coupling of microscopic with macro- 
scopic has an unexpected and quite breathtaking beauty. 

6.7.2 Flows and flow diagrams 

A renormalization operation differs in a very deep sense from all the usual 
calculations performed within the statistical mechanics of Boltzmann and 
Gibbs. In statistical mechanics you start with a statistical ensemble, usually 
defined with a Hamiltonian, and use that ensemble to calculate an average. 
In a renormalization operation, you start with a statistical ensemble, usu- 
ally defined by a Hamiltonian, and you calculate another ensemble, often 
described by a Hamiltonian containing different couplings. In one case the 
calculation is, in brief, ensemble generates averages, in the other, the calcu- 
lation is ensemble generates ensemble. This is quite a substantial difference. 

The part of mathematics that goes with standard statistical mechanics is 
probability theory. The part of mathematics that goes with renormalization 
is called "dynamical systems theory," and describes how things change under 
transformations. The concepts of a fixed point and of a basin of attraction 
belong to dynamical systems theory rather than probability theory. 

Dynamical systems theory is often used to describe continuous changes, 
as for example the changes in a mechanical system as its state changes in 
time. For the purposes of this section, I will speak as if all renormaliza- 
tion transformations were continuous changes produced by an infinatesmal 
increase in a basic length. Thus, the transformation will be, a ^ a -|- d£. 
Then, every coupling also undergoes an infinitesimal change K K+dK. In 
particle physics this kind of approach has the name of the Callen-Symanzik 
equation[13, 72, 73]. 

The simplest kinds of flow pictures look at a single couphng constant. 
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K=Q fixed point 



K=infinity fixed point 



Figure 12: Flow diagram for one-dimensional Ising model. Renormalizations 
weakens the coupling and pushes it toward a weak coupling fixed point at 



Figure 13: Flow diagram for two-dimensional Ising models. There is a crit- 
icial fixed point at K = Kc- For initial couplings weaker than this value, 
renormalizations further weaken the coupling and push it toward a weak cou- 
pling fixed point at if = 0. Conversely, if the initial couplings are stronger 
than Kc, renormalizations produce a flow toward a strong coupling fixed 
point, describing a ferromagnetic state. 

K, and how that coupling changes under renormalizations. In the one- 
dimensional Ising model, depicted in Figure (12), each renormalization makes 
the coupling weaker. Thus the coupling flows toward the weak coupling fixed 
point at if = 0. In contrast, the flow in Figure (13) describes the two- 
dimensional Ising model. The flow is zero at the critical fixed point. To the 
left of the critic fixed point all couplings flow toward the weak coupling fixed 
point at if = 0; to the right all flows go toward the strong coupling point at 
if = oo. This diagram describes a system with a single critical point, but a 
total of three fixed points. 

We have come a long way from the starting point set by Boltzmann and 
Gibbs. Solutions to problems in statistical mechanics has here been described 
in terms of renormalization group flows, universality classes, and types of 
fixed points. This new language has become important in statistical physics 
and has been extended to applications well beyond the situations described 



if = 0. 




■+ ^ ^ 

K=infinity fixed point 



K=0 fixed point 
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here. This language, derived from statistical mechanics, has become even 
more pervasive in particle physics, where coupling constants run everywhere. 
A calculational method is more than a way of putting symbols on paper. It 
provides a way of looking at, and conceptualizing, nature. 

6.7.3 The renormalization group is not a group 

Although the renormalization operation is usually described as a part of a 
group, it actually forms a semigroup. A group is a set of operations with 
three characteristics: 

• Two operations in the group, taken in succession, produce another 
group operation. 

• The group contains an element called the identity, which has the effect 
of changing nothing whatsoever. 

• For each operation in the group there is, as part of the group, an inverse 
operation, so that when you successively perform the operation and its 
inverse, that pair of operations produces the identity element. 

A semigroup lacks the third characteristic. Once you have performed a group 
operation you cannot necessarily undo that operation. 

The reason that renormalization produces a semigroup is that a block 
transformation (see Sec. (6.4)) loses information. After the transformation, 
the system contains fewer lattice sites and so can hold less "information." 
Some irrelevant couplings, which could be seen before the transformation 
have simply disappeared. (These couplings have the index value y = — oo. 
In addition, there are other kinds of couplings, called "redundant" that do 
not affect the free energy and so disappear without a trace in the course of a 
renormalization. ) Both kinds of coupling make renormalization a semigroup 
operation. 

This characteristic is important because it eliminates or greatly reduces 
the possibility of finding the small-scale Hamiltonian of the system by look- 
ing at large-scale phenomena. Before the use of renormalization methods 
scientists often though that a sufficiently accurate and detailed study of a 
system, albeit a study conducted on a large length scale, could determine all 
the basic laws governing the system, down to the smallest scale. In practice 
the disentanglement of microscopic laws always proved to be hard. But, in 
principle, it was always assumed to be possible. But the renormalization 
group theory says that information will disappear in the process of changing 
length-scales. Even ordinary irrelevant operators have effects that disappear 
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with exponential rapidity in the course of a renormahzation transformation. 
These do not produce, in principle, a disappearance of information but they 
make it well-nigh impossible to reconstruct a small-scale Hamiltonian from 
large-scale data. 

Thus, it is often wise for a scientist to consider the macroscopic world to 
either be interesting on its own merits, or not at all. We cannot expect to 
gain very much reliable information about the microscopic world from the 
direct examination of the macroscopic one. (We can, on the other hand, 
gain lots of insights that can be employed to help construct theories about 
microscopic phenomena.) Happily, the existence of quite non-trivial fixed 
point behavior shows that the macroscopic world has quite enough interest 
to engage the imagination of an intelligent scientist. 

The previous paragraph was constructed to describe a situation in which 
there is but one macroscopic world to understand. In fact, there are many. 
Each fixed point described by the renormahzation group defines its own 
unique little world. Thus a plasma is different from a magnet that in turn 
is different from a set of defects in a crystal lattice. Each of these physical 
systems defines its own little world with rules and physical laws. This point 
will be developed further in the next section. 

6.8 A calculational method defines many worlds 

Wilson, in essence, converted a slightly vague phenomenological theory into 
a well-defdined calculational method. So are they all: classical mechan- 
ics, quantum mechanics, statistical mechanics, field theory,...., all calcula- 
tional methods. But they are also each complete descriptions of some "sub- 
universe." As such, they each engender their own world and their own phi- 
losophy. As you can see from the set of ideas outlined in Sec. (6.7), the 
renormahzation group built its own set of philosophical perspectives, which 
then displayed both condensed matter and particle physics in a new and 
different light. 

However, there is an additional deep sense in which the renormahzation 
group defines its own worlds. Each fixed point is a microcosm, worthy of 
study on its own merits. I spent many years studying the two-dimensional 
Ising model near criticality, learning particularly about the behavior of its 
correlation functions. I feel the richer for the experience. 

How can I justify viewing each renormahzation group fixed point as its 
own little world? Each fixed point has its own basin of attraction defined by 
its very large set of irrelevant couplings. This basin of attraction is the region 
in the space of possible Hamiltonians that will eventually produce flows into 
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our particular fixed point. We can visualize the flow as the simultaneous 
diminution of each of these variables. When two or more of these variables 
interfere, we can see non-linear effects in the flow toward the fixed point. 
Since we expect that our listing of irrelevant variables is a complete list, we 
expect that two variables acting together will produce an effect that we can 
describe as a summed effect of the variables on our previous list. In this way, 
we get a kind of multiplication table in which the product of any two variables 
is a sum of the others with specified coefficients. Such a multiplication table 
is what the mathematicians call an algebra. This algebra defines in the 
deepest way what is happening in the phase transition. 

The algebras that have actually been studied are a little deeper than the 
one just described. They are produced not just by the couplings, but by 
the specifications of the couplings in local regions of the system. Therefore 
the algebras combines the properties of space with the properties of the 
particular fixed point. They have been most richly studied in two dimensions 
in which the spatial part common to all these algebras is called the Virasoro 
algebra[81] and the application to critical phenomena was championed by 
Dan Priedan, Dongan Qu, and Stephen Shenker[25]. This approach also 
plays an important role in string theory. 

Each fixed point has its own unique algebra that describes the structure 
of the local correlations determining the fixed point behavior. This algebraic 
structure was originally emphasized by Kenneth Wilson [87] and myself [40] 
under the names of short distance expansion and operator product expansion. 

6.9 Building upon the revolution 

This Wilson renormalization theory provided a basis for the development of 
new methods that could be used for building an understanding of critical 
phenomena. It provided a framework into which one could fit a variety of 
different theories and physical problems. 

6.9.1 The e-expansion 

One example is the e- expansion of Wilson and Fisher [89]. Here e means di- 
mension minus four. This calculational method focuses upon the dependence 
of physical quantities upon dimension. It uses renormalization transforms 
near four dimensions, where mean field theory is almost, but not quite, 
correct The idea of using the dimension of the system as a continu- 

^^The idea of variable dimensionality is also used in particle physics under the name 
dimensional regularization. One of its earliest applications was in the work of 't Hoooft 
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ously variable parameter seems a bit strange at first sight. However, in 
the momentum-space representation of statistical ensembles, each term in a 
perturbation expansion can be evaluated for all integer values of the dimen- 
sion and then the analysis can be continued to all values of the dimension, 
including non-integer values. 

When applied near four dimensions this method allows an almost exact 
analysis of the fixed point behavior. Near the fixed point, the non-trivial 
terms in the free energy, like the term proportional to D in Eq. (20), go to 
zero as the dimension approaches four. Because of this simplification, the 
method gives quite accurate results for critical behavior near four dimensions. 
Further, it provides a series expansion that gives useful answers for many 
different models in three dimensions. The close correspondence of theory 
and experiment helped to convince people that both the variable-dimension 
method and the renormalization method were valid. The way had been 
opened for an explosion of new calculations and new understandings. 
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